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This report reviews the development of the peer 
review process at The University of Tennessee at Knoxville (UTK) and 
presents perceptions of the process after 1 year of implementation. 
The perceptions presented are from a survey of department heads and 
some faculty who had completed the peer review process. Responses 
included comments about the development of departmental guidelines, 
the funding of teaching research strategies, and vays of helping the 
instructor who is deemed to be inadequate. The report presents 
suggestions for improving the process as provided by these 
participants. Six conclusions from the survey are highlighted and 
briefly discussed: (1) the peer review process developed at UTK 
Knoxville rvieflects the current literature on the subject of faculty 
evaluation; (2) even though the mandated guidelines are minimal, they 
are not always properly adhered to; (3) the use of the results is 
unclear to most faculty and a source of great disquiet to some; (4) 
the rewards given for good teaching are generally viewed as grossly 
inadequate; (5) there is widespread support for the improvement of 
instruction on campus; and (6) there is a clear need for the 
administration to provide leadership in the support of the 
improvement of instruction. Contains 34 references. (GLR) 
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You cannot teach a man anything; 
you can only help him to find it 
within himself. 

Galileo 
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There are no responsibilities more essential at an academic 
institution than teaching. Although few faculty have been trained 
as teachers, they are hired with the expectation that they will be 
effective instructors (Seldin, 1988). During the past decade empha- 
sis on improving undergraduate education coupled with mandates 
for public accountability have focused attention on teaching, particu- 
larly the evaluation of instruction (Aleamoni, 1987; Arreola, 1987), 

Unfortunately, for faculty, the subject of teaching evaluation 
is fraught with discomfort and distrust. There are several reasons 
for this. One is the perception that faculty evaluation is subjective 
and frequently void of built-in checks and balances. Added to this 
is the confusion about the use of the results: Who will have access 
to them, and how will they be used? Lack of a stable, focused body 
of evaluative criteria is another concern: What exactly will faculty 
be evaluated on, and who will evaluate? Belief that little value is 
placed on teaching by decision makers is also troubling. This belief 
is reinforced by an environment that offers few rewards and few 
opportunities for improvement. Finally, the past decade has seen a 
dramatic increase in the use of student evaluations. Many faculty 
believe an overreliance on this source turns teaching evaluation 
into a popularity contest. In spite of these reservations, teaching 
evaluation is a fact of life in most institutions of higher education 
today, and faculty concerns continue to exist. 

At the core of every teaching evaluation program is the pur- 
pose which guides the structure of the process: the questions that 
are asked, the sources of information that are tapped, and the way 
in which data are analyzed (Seldin, lb84). Summative evaluation is 
conducted for administrative decisions such as pay increases and 
promotion and tenure deliberations while formative evaluation is 
designed to improve teaching. Some types of data are useful for 
one purpose or the other. Classroom observation is one example. 



General agreement exists in the literature that classroom observa- 
tion is useful only if the evaluated faculty member invites a peer to 
look for specific problems for purposes of teaching improvement. It 
is not particularly useful in providing information about overall 
effectiveness because most observations lack validity and reliability 
(Yanners & Tanpas, 1986). 

Summative faculty evaluation is a complex matter that has 
relied increasingly on student evaluations (Andrews, 1985; 
Aleamoni, 1987; Centra, 1987; Cohen, 1980; Cohen & McKeachie, 
1980). There is recognition, however, that comprehensive and effec- 
tive instructional evaluation systems for personnel decisions con- 
sist of several components, one of which is peer review. With 
varying degrees of success, the involvement of colleagues in the 
evaluation of instruction ranges from informal conversations to 
reviews of instructional materials to classroom ob ovations 
(Braskamp, Brandenburg, & Oiy, 1984; Centra, 1986; Cohen & 
McKeachie, 1980; French-Lazovik, 1976; Grasha, 1977; Skoog, 
1980; Yanners & Tampas, 1986). Agreement exists among Centra 
(1987), French-Lazovik (1976), Seldin (1984) and others that a suc- 
cessful peer review process should be used in conjunction with 
other methods and should meet the following criteria: 

1. Faculty develop and accept a process; 

2. Peers will rate only the dimensions they are competent to 
rate; 

3. The process is tied to efforts for recognition, reward, and 
improvement; and 

4. Mechanisms are included for the evolution of the process. 

The purpose of this Teaching-Learning Issues is to review the 
development of the peer review process at The University of Ten- 
nessee, Knoxville and to present perceptions of the process after 
one year of implementation. During the 1990-91 academic year, 
the Teaching Council of the Faculty Senate surveyed department 
heads and some faculty who had completed the peer review pro- 
cess. Those results are presented here. 

Development of the Process 

In 1985, joint action by the Faculty Senate and the Office of 
the Provost at the University of Tennessee, Knoxville created the 
Committee to Evaluate Instruction. The charge to the committee 
was to develop a "better means of evaluating teaching, including 
areas such as advising which are parts of the teaching commit- 
ment." Serving on the committee were Gary Schneider, Chair 



(Agriculture); Henry Frandsen (Mathematics); Dottie Habel (Art); 
Anne Hopkins (Academic Affairs); Marcia Katz (Nuclear Engineer- 
ing); Marian MofFett (Architecture); John Morrow (History); Ellie 
Moses (Social Work); Jay Stauss (Human Ecology); and Bert 
Welker (Student Representative). In its final report in October 
1987, the committee presented a number of observations which are 
congruent with the literature on peer review. Influencing its rec- 
ommendations were the following points: 1) faculty perceive that 
teaching is undervalued in promotion and tenure decisions; 2) poli- 
cies and procedures clear and acceptable to the majority of faculty 
are needed; 3) there needs to be a direct link between performance 
evaluation, and rewards; 4) a primary reason for evaluating teach- 
ing is to provide information for sound personnel decisions; 5) suc- 
cessful evaluation of teaching should be coupled with means for 
improvement; 6) multiple sources of information should be used to 
assess both . teaching and knowledge of subject matter; and 5) peer 
review is appropriate to evaluate "knowledge of the subject, course 
objectives, assignments, examinations, and contributions to depart- 
mental teaching efforts." The committee made the following final 
recommendations which were approved by the Faculty Senate and 
the Provost: 

• The teaching performance of all faculty, regardless of their 
academic rank or tenure status, must be subject to rigorous 
and thorough review. 

• The required evaluation of teaching must have two major 
components, student surveys and peer reviews. 

• Details of the required assessment of teaching effectiveness 
should be drawn up by a Senate-Provost committee and 
brought back to the Senate for approval prior to 
implementation. 

The Senate- Provost Teaching Evaluation Implementation 
Committee was appointed and charged with designing the two 
components of evaluation, peer review and student surveys, as well 
as developing guidelines for the use of the information generated. 
Chaired by Marian Motfett (Architecture), committee members 
were William Bull (Chemistry); Edwin Burdette (Civil Engineer- 
ing); Henry Frandsen (Mathematics); Dottie Habel (Art); Anne 
Hopkins (Academic Affairs); Anne Mayhew (Economics); R. Baxter 
Miller (English); Carl Pierce (Law) and Tom Ladd (Management). 
In 1989, the committee presented a peer review process that was 
adopted by the Faculty Senate and implemented during the spring 
semester 1990. Believing that peer review is most appropriately 
used to evaluate the instructor's knowledge of the subject, course 



objectives, assignments, examinations, and contributions to depart- 
mental teaching efforts, the process directs faculty peers to inspect 
and evaluate an array of course material while encouraging de- 
partments to define additional evidence of teaching quality that is 
germane to their particular discipline. Guidelines direct the selec- 
tion of a three-member team of faculty peers, the selection of 
courses for review, the criteria for evaluation, and the submission 
of a written report. 

Instructions to department heads regarding the implementa- 
tion of peer review emphasize the critical role the department head 
plays in the evaluation process. The careful analysis of the data 
received to determine teaching performance as well as establishing 
a climate for evaluation are part of the department head's respon- 
sibilities. Specifically, the department head establishes the peer 
review schedule in the department, sees that a policy explaining 
the details of peer review is written and distributed to all faculty, 
appoints the chair for each peer review team, and assists faculty in 
preparing for the review. Finally, it is the department head's re- 
sponsibility to interpret the final report of the team, using this 
information in concert with other data to determine whether the 
instructor's teaching is outstanding, competent or inadeqtiate. 
Department heads are cautioned about the possibility of faculty 
biases affecting peer reviews. 

Faculty participate in the peer review process in two ways. As 
the subject of peer review, faculty prepare for committee review an 
array of course material, including syllabi, examinations, assign- 
ments and other written materials. They will also select one other 
faculty member as a member of the peer review team. 

Secondly, as part of a peer review team, tenured faculty serve 
as members or chairs, reviewing the portfolio and submitting a 
written evaluation of the materials submitted. Three questions 
guide the review: 

• Is the material appropriate for the course being taught? 

• Are methods used for student evaluation fair, appropriate, 
and well executed? 

• Is the general quality of the material satisfactory? 

In answering these questions, the committee reaches agree- 
ment about the quality of the portfolio as outstanding, competent, 
or inadequate. 

Faculty also serve as members of a joint Senate/Chancellor's 
Committee on the Evaluation of Teaching, a committee recom- 
mended by the 1985 Committee to Evaluate Instruction, The 
charge to this committee is to monitor the evaluation process. 
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consider any other aspects of teaching evaluation as may arise, and 
recommend any modifications of the teaching evaluation policy to 
the Senate and the Chancellor. At the present time, the following 
individuals serve on this committee: Marian Moffett, Chair (Archi- 
tecturer, William Bull (Chemistry); Henry Frandsen (Mathemat- 
ics); John Graveel (Plant and Soil Science); Tricia McClam 
( Education K Ralph Norman (Academic Affairs); Wayman Scott 
(Engineering); and Richard Wirtz (Law). 

An Evaluation of the Process 

Because a number of concerns have been expressed through- 
out the University about the peer review process, the Teaching 
Council, a comTiittee of the UT Knoxville Faculty Senate, investi- 
gated the process after a year of implementation. The following 
questions guided the study: 

♦ Is the process viewed as a fair one by the faculty being 
evaluated? 

♦ What elements of the teaching process are actually 

examined? 

♦ Do the faculty who have been evaluated and the depart- 
ment heads to whom the reports are submitted have sug- 
gestions for the improvement of the process? 

The first stage of the investigation was to query department 
heads about their reactions to the mandated process and to ascer- 
tain from them a list of faculty in their departments who had al- 
ready participated in the peer review process. The second stage 
was to query those faculty so identified about their reaction to and 
experience with the process. The response rate from both groups 
was high. Approximately 50% of all department heads responded 
as well as administrators in the Colleges of Law, Architecture and 
Planning, and Nursing. They identified 139 faculty members who 
had completed the peer review process. Almost half (68) of those 
faculty members provided their perspective on the process. Many 
others noted that they were still ir the process of being evaluated 
during the academic term the survey was received and cculd not, 
therefore, gauge their reaction until the process was completed. 

Department heads responded to a 12 item survey that included 
items on the adoption of departmental guidelines more specific 
than those mandated by the University, priorities about who will 
be evaluated, the materials required for committee examination, 
the role of classroom visitation, resources for improvement, and 
suggestions for improving the process. 
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following two comments: "Written materials alone cannot convey 
the quality of student-faculty interaction" and ''review of (written) 
materials is only going through the motions (of faculty evaluation)." 

Those who did not favor classroom visitation generally fell 
into one of two camps — those who opposed it on pragmatic grounds 
and those who were opposed to it on the grounds that it was, in 
some way, unfair to the instructor. Comments of the former type 
included "it (classroom visitation) is a burden for a large under- 
staffed department." 

Opposing comments included the following: "the faculty feel 
it would be a *dog and pony show' "; "we feel that spot evaluations 
would be unsatisfactory and too much observation would be a bur- 
den"; "visitors to the classroom are viewed as changing d3aiamics 
somewhat; thus one-class observation may ot give an accurate 
portrayal of the total semester or even of overall style." The college 
most opposed to classroom visitation appears to be the College of 
Education. Perhaps department heads in this college are familiar 
with educational research that does not support its use in 
summative evaluation, the ostensible purpose of UT Knoxville's 
mandated process (see page 4), 

Examination of written materials 

Few departments/programs use a written statement of the 
teaching philosophy of the instructor being evaluated (only 20% did 
so). On the other hand, practically every departmentyprogram sur- 
veyed used course syllabi and examinations. Slightly fewer peer re- 
view committees examined student evaluations of the courses 
taught (about 80%). 

Committees examined a myriad of other wrif,:en materials. 
Over 30% of the responding departments/progra.ns examined 
course handouts. A few departments suggest Iroking at student 
grade distributions, and others recommend that some evidence of 
student work/outcomes be included. This latter requirement ap- 
pears especially important in programs which emphasize studio or 
practicum experiences. Reading material is also examined by some 
departments/programs as well as audio-visual materials used in 
the classroom. 

Two departments require that the review committee hold an 
interview with the instructor being evaluated, and one department 
interviews a small sample of former students as to the instructor's 
perceived effectiveness in the classroom. 

Renponse to the Process as Experienced 

The response to the Likert-type scale of reaction to the pro- 
cess as experienced to date showed that most respondents were 
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neutral (i.e., a response of 3 on a five-point scale). The respondents 
were more positive than negative, however, as values of 4 and 5 
(positive experiences) outnumbered values of 2 and 1 by a ratio of 
2:1. One department head rated the experience with the process 
low because "assessment does not improve teaching." 

The Development of Departmental Guidelines 

Few departments/programs have guidelines for the composi- 
tion of the peer review teams that differ from those suggested by 
the process adopted by the Faculty Senate. The gist of the addi- 
tional requirements in four of the five departments/programs that 
have developed specific selection guidelines, is to assure that an 
"outsider" (i.e., a dispassionate, impartial observer) was included 
as a member of the team. The "outsider" can simply be a person in 
another programmatic area within the same department, a person 
outside the department but within the college or, in two cases, an 
extracollegiate colleague. The fifth department required that all of 
the evaluators come from within the department, counter to the 
generally perceived need to "open up" the process. 

There are also examples of departures from the suggested 
guidelines governing peer rev-iew. One department violated the 
original guidelines of the joint Senate/Chancellor Committee by 
assigning two-person peer review committees. One of the two mem- 
bers was selected from among tenured members of a standing de- 
partmental committee on faculty development, and the other was 
chosen by the instructor being evaluated. Likewise, it is uncommon 
for several instructors from the same department to be evaluated 
by the same peer review evaluation team. But such has been the 
practice in some departments, especially when several instructors 
are being evaluated in the same academic term. 

Ways to Help the Instructor Who is Deemed "Inadequate" 

Remediation of faculty deemed "inadequate" as a result of the 
peer review process proved to be an area where guidelines are 
needed. One department head even pleaded that the Teaching 
Council should "come up with some recommendations for this." 

The first logical step seems to be counseling with the peer re- 
view committee and the department head. Several mentioned that 
the annual MBO (management by objective) conferences may be 
the appropriate time to suggest remediation alternatives but that 
it is difficult to get some tenured faculty members to change their 
modus operandi even when threatened with monetary sanctions 
(e.g. lower than average salary increases). 

Some suggested imposing sanctions such as denial of tenure 
for "inadequate" teaching among the untenured professors in the 
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department and zero merit raises for those with tenure. Others 
suggested more positive interventions such as pairing the faculty 
member deemed inadequate with a mentor considered to be an ex- 
cellent teacher in order to learn the craft from those who perform it 
best. Mentoring with respect to teaching is evidently widely prac- 
ticed now across a variety of departments. 

One department allows the instructor deemed inadequate by 
the peer review team to prepare a formal rebuttal to the charges. 
While this may appear a bit formalistic, it is fair given the sug- 
gested importance of teaching adequacy to promotion, tenure, and 
merit raise decisions. Many departments felt that the problem of 
inadequate teaching must be considered on a case-by-case basis 
(i.e., there is no magic formula that would work well across the 
board). 

The Perceived Role of the Learning Research Center 

Suggesting that the instructor seek help from the Learning 
Research Center f LRC), while generally applauded, was not with- 
out its detractors. Those who hesitated to suggest the LRC as a vi- 
able source of remedial help seemed to feel that LRC did not have 
content specialists available who understood the special teaching 
requirements in their discipline and that remediation would be bet- 
ter handled within the confines of the department. As one depart- 
ment head put it, outside holp should be sought "only if the person 
had a sense of the nature of the discipline and tne various ways it 
might best be taught." This was a sentiment especially felt about 
studio courses where a "different teaching methodology was re- 
quired." Others expressed concern about the **efficacy of such mea- 
sures" (i.e., suggesting that the instructor seek help from the LRC). 
Some were not sure what array of services the LRC offered. 

Funding Teaching Improvement Strategies 

Should monies oe allocated for the improvement of teaching? 
Department heads responded with a resounding, but qualiHedt 
'Ves. ' The qualification expressed by most department heads is. 
not surprisingly, the sad shape of departmental operating funds 
and budgets in general. Many respondents said they support the 
idea in principle, but only if the fin^incial backing for the effort 
came from new monies. One suggested that a private endowment 
ioight be approached with the idea of providing money for teaching 
improvement. 

There seems to be no consensus about the implementation of 
measures designed to improve teaching. One department felt the 
money should not be spent on "projects that sound good but do not 
accomplish much." A second department head expressed an even 
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more cynical view: "it is doubtful that monies for this purpose 
would be well spent." Another department felt it was at least as 
important to devote financial resources to the improvement of re- 
search as to the improvement of teaching: "Our faculty have as 
many questions about how one becomes involved in the research 
enterprise as in teaching." 

A few departments were in favor of the allocation of monies 
to improve teaching only if these new funds were given directly to 
the departments. Others qualified their support dependent upon 
the conditions under which the funds could be used and the admin- 
istrative guidelines that might be developed to govern their 
disbursement. 

Suggestions for Improving the Process, 

The final question asked of the department heads was an 
open ended one — do you have any specific suggestions for the im- 
provement of the peer review process or teaching in general? The 
responses were varied and intriguing. What follows is a sample of 
opinions and ideas: 

• We feel that an effective form of feedback to an instructor 
requires in-depth knowledge of that person's view of the 
course and that person's intended teaching style. 

• I believe that classroom visits should be required of the 
evaluation committee. (Three responses) 

• I sadly fear that we may overtax the willingness of the ten- 
ured faculty to staff these teams, but it is hard for us to 
imagine how a peer review system worth having can oper- 
ate without class visitations. 

• Try correlating grades in classes and student evaluation. 
Measure how much students learn from an instructor by 
correlating grades in a course with the grades received by a 
student in subsequent dependent courses. 

• Drop the system. It is another time waster. We are con- 
stantly evaluated. This system of peer evaluation is a re- 
sponse to political pressure and does not enjoy widespread 
support. On the contrary — it breeds cynicism. 

• Allow each department to refine its approaches without too 
heavy a hand from procedures set in concrete from people 
who assume all teaching is lecture/lab style. Most of the 
arts are one-on-one where personality and individualization 
are key to success. 

• It would be interesting to know v/hether other departments 
are as serious about the process as we. 
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• I would suggest that departments submit a teaching evalua- 
tion package to the University and let them (i.e., adminis- 
trators) go about it. 

• I would welcome more specific instructions and would espe- 
cially welcome suggestions for follow-up and for how to 
work with those who need help. 

• Take pains to avoid duplication in the types of surveys 
conducted. 

• Expand the categories for the rating; three is too narrow. 

• i suggest that a cadre of excellent teachers be formed to as- 
sist inadequate teachers. Selection to this cadre should be 
based on demonstrated performance and be limited by re- 
newable terms. They should receive extra service pay and 
have been trained in the cHnical observation model by Col- 
lege of Education faculty. 

• Quoting from a faculty member about his or her experience 
with the peer evaluation process as currently practiced: 
'The most difficult part is arriving at an evaluative conclu- 
sion — one word — that labels his/her teaching (and only 
based upon materials at that). If this is an evaluation as- 
sessment, it should be done by administrators. If it is diag- 
nostic, then a list of strengths, weaknesses, and suggestions 
for improvement would make sense. What we don't need is 
a more meticulous, detailed review process. What we do 
need is a simplified, helpful process that will assist us in be- 
coming better teachers without pitting us against each 
other while doing so." 

Responses from Faculty 

The department heads/program administrators who re- 
sponded to the first survey identified 139 instructors who had un- 
dergone the peer review process. A second survey asked this group 
about the process as they experienced it. Specifically, the survey 
addressed the selection of committee members, the materials re- 
viewed, and classroom observation. Participants were also asked 
about their beliefs about peer review and their suggestions for im- 
proving the process. The response rate to this survey (49%) was 
high and indicated a keen interest in peer review. The responses 
represented a broad sampling of faculty across all academic ranks 
and all colleges. What follows is a brief summary of their responses. 



The Peer Review Experience 

The fjreat majority of the respondents (70%) had peer review 
committees composed of members of their own departments. To the 
question about whether the person was allowed to select which 
coursecs; should be evaluated, an equal number responded affirma- 
tively and negatively. Most of those who responded negatively felt 
the courses for evaluation were chosen simply because they were 
the only ones being taught or were those most recently completed 
The choice was viewed by most as a pragmatic response to hurry 
the process along. 

The majority of respondents were able to decide upon the ma- 
terials to be included in their own portfolio. Of the fifteen who re- 
sponded that they were not given such an opportunity, seven 
suggested that the department had not developed guidelines as to 
what could or could not be included in such a portfolio. Everyone 
who was evaluated shared course syllabi with the peer evahiation 
committee. Almost everyone did the same with course examina- 
tions and assignments. The least frequently supplied materials in- 
cluded, in ascending order of frequency, letters of support and/or 
testimonials from former students, grade distributions within the 
course(s) being taught, audio-visual materials utilized, and state- 
ments of teaching philosophy. 

About an equal number of instructors did and did not receive 
classroom visits from peer review members as part of their evalua- 
tion. Even within departments, the use of classroom visitation was 
variable. Those whose evaluation included classroom visitations 
were, for the most part, given prior notification of the visitation 
date(s). One department specified that the reviewers were to visit 
three separate class meetings, but one visit appears to be the norm 
among the departments/programs that encourage or require class- 
room visitation. 

The procedures for peer review are by no means uniform 
across campus. The majority of the respondents (62%) did not meet 
with their committee per se prior to the evaluation. This prompted 
some to comment that they wished they had included more written 
materials in their portfolio, but were unaware they could do so. 
Mandating a preliminary meeting to set the "ground rules" for the 
evaluation would overcome some the of the uncertainty presently 
experienced. 

When asked whether they met with their committee during 
the course of the evaluation process, a majority of those who did 
not do so at the beginning also did not do so subsequently Many 
responded that they did not feel the need to do so. Likewise a ma- 
jority (69%) did not meet with the committee after the evaluation 
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process terminated though some commented that they met infor- 
mally with selected committee members. About an equal number 
who did not meet with the committee members after the evaluative 
process did, in fact, receive a "de-briefing^ and/or a copy of the writ- 
ten report from their department heads. 

An overwhelming percentage of the respondents (91%) 
thought that the peer reviev/ process was fair and unbiased. Many 
commented that they really gained much from peer review commit- 
tees that took their job seriously and produced a useful critical 
assessment. 

There was, however, an undercurrent of disquiet expressed 
about the purpose the process was supposed to serve. A few 
evaluatees noted that more verbiage in their reports was spent on 
the problems inherent in the review process than on suggestions 
for the improvement of their own instruction. 

Beliefs about Peer Review 

Participants responded to statements about peer review using 
a Likert-type response scale (Table 1). A response of 4 or 5 was 
judged to be favorable to the issue involved. Likewise, a response of 
1 or 2 was judged to be unfavorable. A response of 3 was judged to 
be neutral or ambivalent. 

Most respondents agreed that peer review was both necessary 
and important (57%). And, by an even greater margin (68%), they 
felt that classroom observation should be a necessary component of 
the process. This was the case even though less than half had actu- 
ally been observed in the classroom setting by their peer review 
committee members. 

A slight majority felt that the current tripartite classification 
was inadequate to properly summarize the cvaluatee's teaching. 
Few thought that that the current guidelines for peer review were 
unfair, but many were either neutral on this issue (45%) or were 
uncertain about the nature of the guidelines even though copies 
had been distributed to every faculty member by the Chancellor's 
Office. 

Practically everyone responding to the survey (P/2%) felt 
strongly that instructors deemed "inadequate" should be helped, 
but there was slightly less support for the allocation of funds to 
implement intervention or remediation measures. 

The questions about teaching per se reveal a great deal about 
the psyche of the typical college professor. No one rated himself or 
herself a'^poor" teacher. In fact, only 11% even saw themselves as 
merely "adequate." All of the rest thought they were "good" to "ex- 
cellent" teachers. 
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Table 1 

Belief Statements About Peer Review 



1. 1 think the peer evaluation of teaching as currently imple- 
mented at UTK is necessary and important. 

2. I think it is important for the peer evaluation team to visit the 
classroom to observe teaching firsthand. 

3. I think that the three categories of evaluation (i.e., "outstand- 
ing," "competent," "inadequate") are sufficient for the purposes 
the peer evaluation is intended to serve. 

4. I think the operational guidelines developed by the Joint Chan- 
cellor-Faculty Senate Committee on Teacher Evaluation are 
fair and unbiased. 

5. I think that teachers who are categorized as "inadequate" as a 
result of the peer evaluation process should be offered help to 
improve their teaching. 

6. Despite budget problems, I would be willing to see financial re- 
sources expended on intervention measures to improve the 
quality of teaching on campus. 

7. I would be willing to participate in a course/seminar designed 
specifically for college teachers to discuss teaching issues and 
to help improve my own teaching. 

8. I consider myself a good teacher. 

9. I wish that I had been offered the opportunity for more training 
in teaching methods and pedagogy within the context of my 
own advanced degree program. 

10. I feel equally well qualified to teach a small group of students 
in a seminar, laboratory/studio format and a larger group in a 
lecture or lecture/discussion format. 

11. I feel more attention should be paid to teaching at UTK 

12. I feel that good teaching is being adequately rewarded at UTK. 



Perhaps because of this overwhelming prevailing attitude, 
only about one-third of the respondents expressed a real interest in 
participating in seminars/workshops on the improvement of in- 
struction. There is typically a non-commitment bias in surveys that 
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ask only about hypothetical expenditures of time or resources: 
many more respond affirmatively than will actually participate. 
The number of participants in the planned fall semester workshops 
on teaching jointly sponsored by the Teaching Council, the Learj^- 
ing Research Center, the College of Education, and Academic Af- 
fairs may, therefore, be small. , 

As many respondents felt that more emphasis on pedagogical 
training in their own fields of endeavor would have been unnecessary 
as those who said they would have found such an emphasis useful 
The overwhelming majority of the respondents (73%) felt they were 
as adroit in front of a large lecture class as they were when leading 
a small group discussion. Statements 11 and 12 generated predict- 
able responses. The overwhelming majority felt more attention 
should be devoted to the teaching function (59%) or were satisfied 
with the current level of attention being placed on teaching at Ten- 
nessee (35%). But, the bulk of the respondents felt that inadequate 
rewards are currently being bestowed on good teachers (68%). 

Suggestions for Improvement 

The open ended responses were extremely revealing. They 
demonstrate a great depth of concern about the perceived lack of 
acknowledgement of good teaching. They suggest as well some in- 
novative and thoughtful ideas about how to rectify the situation. 

What follows is a sampling of those responses. Some of them 
conflict and others are complementary. No attempt has been made 
to evaluate their merits; this is simply a sampling of opinion on 
some controversial, and perhaps unresolvable, issues. 

• It would be more useful to send me to the classes of teachers 
who have been acknowledged as excellent in order that I 
might be able to pick up some pointers I could incorporate 
in my own teaching, rather than to have members of a peer 
evaluation committee observe my classes. 

• I need help on how to integrate computers into the 
classroom. 

• The quality of classrooms varies dramatically over the 
campus, and this contributes to the quality of the learning 
experience. 

• More team and co-teaching would be desirable. 

• There is a need for a cadre of knowledgeable, trained listen- 
ers who are not close colleagues in order to help those who 
desire it so that they may seek their own solutions for in- 
structional improvement. 
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A probationary year (similar to what's required at the pre- 
collegiate level) would be desirable for new faculty with 
careful supervision by a designated faculty mentor. 
Faculty should be interviewed about their philosophy of 
teaching. 

Teaching evaluation should differentiate between required 
and elective courses. 

Research-active faculty should be encouraged to view both 
teaching and research as strands in the fabric of 
scholarship. 

Standardized grading procedures should be employed at 
Tennessee. 

Peer evaluation should be judged either "satisfactory^ or 
"not satisfactoiy*' on a variety of teaching criteria— course 
preparation, presen\:ation of content, development and 
evaluation of assignments, etc. 

Departments should customize the peer review procedures 
to make the concept fit with the format, traditions and ex- 
pectations unique to that unit. 

Courses being taught for the first time should not be 
evaluated. 

Evaluation should be completed by a cadre of professional 
evaluators using videotaping of classroom performance. 

♦ Teaching workshops should be structured such that partici- 
pants actually develop materials and demonstrate their use, 

♦ Simply have faculty identify the *T3ad" teachers in their 
department. 

♦ Evaluate all teaching faculty every two years. 

♦ Continue the brown bag program (i.e., the Celebration of 
Teaching) to disseminate and discuss teaching approaches 
and "tricks of the trade." 

♦ Do not limit a priori the percentage of instructors who can 
be judged "Outstanding." Such is a ploy by the administra- 
tion to keep from recognizing and rewarding excellence in 
teaching. 

♦ Money for workshops on the improvement of teaching would 
be better spent on A/V and laboratory equipment to improve 
classroom instruction. 

♦ Too much emphasis has been placed on the evaluation of 
undergraduate vis-a-vis graduate instruction. 



• Do away with the mandatory student evaluation of instruc- 
tion and reallocate that money to fund 25 annual teaching 
awards of $2,000 each. ^ 

• Evaluate tenured faculty less often than once every five 
years because you "can't teach an old dog new tricks" 
anyway. 

• Develop a mechanism for establishing teaching professor- 
ships that IS analogous to research professorships. 

• It is doubtful that the peer evaluation process has uncov- 
ered anyone who is not already known as a poor teacher. 

• The peer review process runs the risk of setting colleagues 
at odds with each other. 

• Faculty who refuse to be observed in the classroom should 
be treated like those who refuse a breathalyzer test-pre- 
sumed to have something to hide. 

• Teaching competence ought to be respected as well as hon- 
oring teaching excellence. 

• Professors must be forced to act less selfishly. Dock their 
pay or fire them if they get poor student evaluations Pub- 
lish those student evaluations in the Daily Beacon. 

Obviously, faculty members do not speak with a single voice 
There IS. however, a general feeHng that teaching is important, but 
IS not being recognized and rewarded as such by administrators. 
There is also a feeling that much of the peer review process is 
merely going through the motions" and that inadequate teachine 
IS not being punished any more than excellence in teaching is being 
rewarded. Faculty from small or especially open departments feel 
they already know (mostly from student feedback) who the bad and 
the good instructors are in their departments. But, punitive or cor- 
rective measures have not been taken with the former, and merit 
raises have not been given to the latter. A clear statement issued 
by the administration on the purpose(s) peer review is meant to 
serve would be most welcome. 



Conclusions 

It is difficult to generalize about, much less, summarize, re- 
sults of surveys that engendered such disparate and heart-fek 
"•"l^K "^ r '•^sPo^ded. Nonetheless, six conclusions 

will be highlighted in turn: 1) the peer review process developed at 
UT Knoxville reflects the current literature on the subject of fac- 
ulty evaluation; 2) even though the mandated guidelines are 



19 



minimal, they are not always properly adhered to; 3) the use of the 
results is unclear to most faculty and a source of great disquiet to 
some; 4) the rewards given for good teaching are generally viewed 
as grossly inadequate; 5) there is widespread support for the im- 
provement of instruction on campus; and 6) there is a clear need 
for the administration to provide leadership in the support of the 
improvement of instruction. 

Degree to which Peer Review at UTKnoxville Reflects 
Accepted Educational Practices 

The peer review process developed at UT Knoxville does re- 
flect the characteristics suggested in the educational literature for 
sound evaluative practice. The process is a form of summative 
evaluation used for administrative decisions on promotion, tenure 
and merit pay. As such, classroom visitation need not be man- 
dated. Peer review committees consist of three persons, as the lit- 
erature suggests, although the degree to which committee members 
limit themselves to dimensions of teaching they are competent to 
evaluate is unknown. A large number of faculty were involved 
with the development, approval and implementation of the process. 
There is enough flexibility in the process to allow "customization" 
for particular teaching and disciplines. There is room for improve- 
ment to the process. Experience with the process will, it is hoped, 
lead to more streamlined and effective evaluative procedures. 

Degree to which Procedures Are Being Followed 

The manner in which peer review is supposed to operate at 
UT Knoxville is viewed by most faculty as fair and reasonable. 
There are, however, a few departments that have not followed the 
guidelines. In addition, there are some faculty who claim they have 
not been given adequate information to prepare materials for peer 
review. Nor have some faculty been given the opportunity to meet 
with their peer review committee to discuss the ground niles for 
evaluation beforehand and/or to be debriefed about the results of 
the evaluation afterwards. A statement from the administration 
clarifying the underlying philosophy and purpose(s) peer review is 
to serve is sorely needed to accompany the statement of mechanical 
procedures by which peer review is to be accomplished. 

Use of the Peer Review Results 

The greatest unknowns for faculty regarding peer review are 
the uses to which the results will be put. It is not at all clear to fac- 
ulty how the results of peer review are factored into decisions re- 
garding tenure, promotion and merit raises. Nor is it clear to 
faculty who, besides themselves, the peer review committee and 
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the department head, has access to the committee's report. Given 
the importance of the decisions that hinge, in part, on peer review, 
it is incumbent upon the administration to clarify the use of these' 
results. There is, for example, a widespread rumor circulating that 
prespecified percentages of faculty will fall into each of the three 
evaluative categories (i.e. ''outstanding," "competent," "inad- 
equate"). More openness about the process would alleviate much 
consternation on the part of faculty. 

Inadequacy of Rewards for Good Teaching 

There is a widespread feeling among the faculty that the 
teaching mission at the University is undervalued by the adminis- 
tration. Even highly visible recognition such as the National 
Alumni Association teaching awards are viewed with cynicism by 
some. Clearly, much more should be done to recognize excellence 
in teaching at UT Knoxville. This recognition need not necessarily 
be of a pecuniary nature. Faculty and administration need to cre- 
ate an atmosphere where good teaching is expected, fostered and 
rewarded. 

Attention to the Improvement of Instruction 

The greatest unanimity of opinion in the surveys was ex- 
pressed in support of improvement of instruction. Though almost 
every one felt that improvement of the teaching at UT Knoxville 
was necessary, there was no accord on how to reach this laudable 
goal. Many felt that the Learning Research Center (LRC) should 
play a vital role in this effort toward instructional improvement. 

The magnitude of the task is, however, beyond the resources 
of the LRC. Given the current budgetaiy woes of the University, it 
is unlikely that monies for teaching improvement can be found 
from existing sources. Some suggested that a private foundation or 
public agency might be approached with a proposal to improve the 
overall quality of instruction. Others suggested the answer might 
be found within the existing resources of the University. A cadre of 
excellent teachers might, for example, be trained to disseminate 
techniques for instructional improvement. Likewise, thought might 
be given to formalizing the practice of peer mentoring with respect 
to teaching. Despite some opinion to the contraiy, every faculty 
member can improve aspects of his or her teaching, and all faculty 
should be targeted in these efforts, not just those deemed "inad- 
equate" by the peer review process. 
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Leadership From the Administration 

Finally, the results of the surveys reveal a deeply felt need 
among the faculty for administrative leadership in the area of 
teaching improvement The more cynical respondents imply that 
administrators do nothing but pay lip service to the importance of 
effective teaching while being niggardly in the allocation of re- 
sources for teaching improvement. 

It is time for faculty and administrators to become less 
adversarial and more open about the purposes of faculty evalua- 
tion. A clear statement of evaluation objectives and a concrete pro- 
gram of action for teaching improvement would go far to combat 
the malaise that seems to have befallen the campus with regard to 
this important issue. 
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